Is infinity that far? A Bayesian nonparametric perspective of finite mixture models
نویسندگان
چکیده
Mixture models are one of the most widely used statistical tools when dealing with data from heterogeneous populations. Following a Bayesian nonparametric perspective, we introduce new class priors: Normalized Independent Point Process. We investigate probabilistic properties this and present many special cases. In particular, provide an explicit formula for distribution implied partition, as well posterior characterization process in terms superposition two discrete measures. also consistency results. Moreover, design both marginal conditional algorithm finite mixture random number components. These schemes based on auxiliary variable MCMC, which allows handling otherwise intractable overcomes challenges associated Reversible Jump algorithm. illustrate performance potential our model simulation study real applications.
منابع مشابه
Nonparametric Estimation of Finite-mixture Models
The aim of this paper is to provide simple nonparametric methods to estimate finite-mixture models from data with repeated measurements. Three measurements suffice for the mixtures to be fully identified and so our approach can be used even with very short panel data. We provide distribution theory for estimators of the number of mixture components, the mixing proportions, as well as of the mix...
متن کاملIncremental Learning of Nonparametric Bayesian Mixture Models: Extended Thesis Chapter
Clustering is a fundamental task in many vision applications. To date, most clustering algorithms work in a batch setting and training examples must be gathered in a large group before learning can begin. Here we explore incremental clustering, in which data can arrive continuously. We present a novel incremental model-based clustering algorithm based on nonparametric Bayesian methods, which we...
متن کاملThesis Title: Bayesian Nonparametric Regression through Mixture Models
This thesis studies Bayesian nonparametric regression through mixture models. These types of models are highly flexible, yet also numerous, which raises the question of how to choose among the models for the application at hand. In answer to this question, we derive predictive equations for the conditional mean and density and carefully analyse the quantities involved. Our main contributions to...
متن کاملSupplemental Information: Streaming Variational Inference for Bayesian Nonparametric Mixture Models
where the inequality follows by Jensen’s inequality [1]. The approximation is tight when q̂(z1:n) and q̂(θ\k) approach Dirac measures. Eq. (6) is that of the standard mean field update for q̂(θk) [2]. Since the q(θk) distributions are unknown for all k, we could perform coordinate ascent and cycle through these updates for each of the θk given the other θ\k and q̂(z1:n). Conveniently, since the q̂(z...
متن کاملNonparametric Bayesian Clustering via Infinite Warped Mixture Models
We introduce a flexible class of mixture models for clustering and density estimation. Our model allows clustering of non-linearly-separable data, produces a potentially low-dimensional latent representation, automatically infers the number of clusters, and produces a density estimate. Our approach makes use of two tools from Bayesian nonparametrics: a Dirichlet process mixture model to allow a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of Statistics
سال: 2022
ISSN: ['0090-5364', '2168-8966']
DOI: https://doi.org/10.1214/22-aos2201